Interactive digital music recorder and player

ABSTRACT

A digital multi-media device provides features for a user unskilled in musical arts or sound handling techniques that provides automatic musical score composition in accordance with contained composition instructions. Stored sound samples and interfaces for obtaining external signals provide signals for merger with visual and sound presentations to obtain altered presentations either time shifted or in real time. In this fashion the user can create simulated radio stations for playback of prearranged and composed audio material. Further, the automatically composed musical score may be mixed with synthesized, digitized signals from the stored sound samples and external signals obtained through the device interfaces.

BACKGROUND OF THE INVENTION

[0001] (a) Field of the Invention

[0002] The current invention relates to a device that provides forinteraction with a user during recording, playing, composing andmodifying musical selections.

[0003] (b) Description of Related Art

[0004] Various devices capable of composing a musical pieceautomatically have been developed, such as that described in U.S. Pat.No. 4,399,731. These devices are based on synthesizers of instrumentalsounds on which are applied, for instance as per the MIDI (MusicalInstrument Digital Interface) standard, “scores” of notes that arecomposed automatically. Various devices capable of recording or playingvideo recordings have already been developed, such as digital or analogcamcorders and other video recorders. These devices can possess one orseveral audio inputs, which permit mixing or replacement of the soundtrack that was recorded originally during the recording of the imagewith an external audio source.

[0005] Furthermore, there also exist various devices that are capable ofplaying recorded pieces, such as digital compact disc players, playersof compressed files (for instance as per the MPEG-level 3 standard),etc. Finally, there exist devices incorporating a tuner, which permitreception of radio broadcasts via electromagnetic waves.

SUMMARY OF THE INVENTION

[0006] An interactive digital multi-media device provides a user withmultiple related features, wherein it is not necessary that the userhave training in musical or sound handling arts. A programmable memoryis used to store digital audio and voice samples. External soundrecovers provide external sound signals, such as radio and TV signalsthat may also be stored. Playback means is provided connected to thestored audio and voice samples and the external sound signals. Automaticmusical composition instructions are stored so that the user is able tocreate unique musical compositions. Components are provided thatfunction to mix externally obtained sound with the unique musicalcompositions and stored audio and voice samples to provide altered audioand voice presentations.

[0007] The present invention includes an improved automatic compositiondevice that adds to instrumental sounds some previously recorded soundsamples wherein the sound samples are mixed with a melody in the processof the automatic composition. The sound samples will typically, but notexclusively, be human voice samples.

[0008] The invention herein further represents an improvement over priorart devices by integrating in a video recorder or player a module thatgenerates music or other sounds which either can be mixed with theoriginally recorded sound (sound mixing), or can replace the originallyrecorded sound (sound dubbing). This sound mixing or dubbing can beperformed either at video/audio record time or at play time.

[0009] Additionally the invention envisions selection of musical pieceseither out of a library stored for instance in the form of digitizedmusical files, MIDI files or other types of files, or from pieces thatare composed in a pseudo-random fashion using, for example, asynthesizer function to play original musical pieces.

[0010] The invention further envisions selection of musical piecesaccording to a specified musical style, in a pseudo-random fashion, oraccording to predefined criteria, wherein the audio files meet thepredefined criteria and are either extracted from a music library or aregenerated by an automatic composition function. The resulting sounds areused either during the video recording or during the video playback.

[0011] The present invention represents an improvement of theaforementioned devices by simulating the reception of a radio station bythe use of one or several of the aforementioned functions. Further, theinvention permits selection of musical pieces, by a user, either from alibrary in which musical pieces are stored as compressed musical files,MIDI files or other similar types of files, from pieces recorded fromthe output of a radio receiver, or from pieces that are composed in apseudo-random fashion using a synthesizer function to play originalmusical pieces.

[0012] Thus, the present invention provides for selection according to apre-selected musical style, in a pseudo-random fashion or according to apre-defined criteria, of audio files to be played from a speaker,wherein the audio files meet the pre-defined criteria and are eitherextracted from the library or generated by an automatic compositionfunction. Further, the recording of or the automatic generation ofsentences that mimic the speech of a “disc-jockey” or of an announcerpermits combination of speech passages with the musical pieces beingplayed, thereby giving the user the illusion that he is listening to anactual radio station.

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The above objects and other advantages of the present inventionwill become more apparent by describing in detail the preferredembodiments of the present invention with reference to the attacheddrawings in which:

[0014]FIG. 1 is a perspective of the digital multi-media device of thepresent invention.

[0015]FIG. 2 is a functional block diagram of the present invention.

[0016]FIG. 3 is a block diagram of the automatic composer of the presentinvention.

[0017]FIG. 4 is a block diagram showing one structure for summingoutputs in the present invention.

[0018]FIG. 5 is a block diagram showing another structure for summingoutputs in the present invention.

[0019]FIG. 6 is a block diagram showing a first variant of the diagramof FIG. 3.

[0020]FIG. 7 is a block diagram showing a second variant of the diagramof FIG. 3.

[0021]FIG. 8 is a block diagram of another embodiment of the automaticcomposer of the present invention.

[0022]FIG. 9 is a block diagram of a variation of the present invention.

[0023]FIG. 10 is a block diagram of another aspect of the presentinvention.

[0024]FIG. 11 is a block diagram of an additional aspect of the presentinvention.

[0025]FIG. 12 is a block diagram of yet another aspect of the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] The present invention will be described in greater detail withreference to certain preferred and alternative embodiments. As describedbelow, refinements and substitutions of the various embodiments arepossible based on the principles and teachings herein.

[0027] The invention disclosed herein is an interactive digital musicplayer that allows one or more users to listen to, compose, and interactwith music in any environment. The device is a hand-held digital musicplayer that offers numerous unique features that, until now, have notexisted in a single music product. One of the many features, theElectronic DJ (e-DJ) automatically composes and plays in real-time musicin a multitude of genres (such as a dance or techno), which can be mixedwith user-supplied voice samples. The e-DJ offers a unique interactiveway of playing with music. At any moment, the user can take the controlof the music played by the e-DJ via an attractive interface (joystick,graphical display). The user can change the music patterns played byvarious instruments, change the relative level, apply effects, playpre-recorded samples, etc.

[0028] Further, the disclosed device allows the user to listen to,create, download, store, and interact with music, and includes an FMradio receiver. Users can listen to both compressed audio and MIDIkaraoke music files, store music on a plug-in SmartMedia memory card(SSFDC storage device), and carry the unit to any location for playing.The device is capable of storing more than 1000 MIDI karaoke-file songson a 64 MB smart media memory card and it can provide over 120 minutesof digital music play time. In addition, the disclosed device is able tocreate music files, accept music files created by the user, downloadmusic from the Internet via a PC, take a music transferred from a PC,or, accept music added from any other smart media memory card. Whenconnected to a docking station, the device offers additional featureslike insertion of Karaoke lyrics in a video source for display on a TVscreen, MIDI PC connection or remote control.

[0029]FIG. 1 shows the device 10 and its docking station 11. A number ofcables 12 are shown for connection to a number of ports (not shown)situated at the rear of the docking station 11. The device 10 as shownhas a group of controls 13, including buttons, knobs, jacks, etc. and adisplay 14 on its front surface. A connector within a slot 16 is shownon the device that is configured to mate with a connector (not shown) ona rear surface of a base 17 on the docking station 11. The dockingstation includes an inclined surface 18 that supports the device in thedocking station when connection is made between the connector in slot 16and the connector in the docking station.

[0030] The device 10 is shown in the block diagram of FIG. 2 and will bereferred to as a Digital Multi Media Platform (DMM) hereinafter. A largenumber of features are included in the DMM, one of which is the abilityto playback digital audio data from a SmartMedia memory card 19. Thedigital audio source is either compressed or MIDI. The DMM offers a userthe capability to interact with a song being played by changing pitchand tempo. The audio compression techniques supported in the DMM isMicrosoft Windows Media Audio (WMA), illustrated at 22 in FIG. 2, havingfiles in the active streaming format (ASF). WMA provides a highercompression ratio for equivalent sound quality as compared to previouscompression techniques, i.e., MP3. DMA compression techniques allow acompression ratio approximately twice that of MP3, thereby allowing forover two hours of music to be stored on a 64 megabyte SmartMedia card.The WMA playback function supports the Digital Rights Management (DRM)technology that is used with audio files. This technology can be used toencrypt the compressed data, which can then only be decoded correctlywith a private key. As a result, a user can download music from theInternet that is protected with the DRM technology and receive rights toplay music on a particular DMM that has been previously registered. ASFand MIDI files can be copied on the SmartMedia card either via a serialPC connection offered by the DMM device or directly with an off theshelf SmartMedia card reader. Internal memory and SmartMedia memory 19further provides the ability for the DMM to obtain firmware and soundupgrades from the Internet.

[0031] An electronic DJ and virtual radio functions are provided by agroup of musical algorithms 21 that allow a user to automatically createand play many different types of music such as dance, techno, rap, easylistening, etc. Unlimited hours of random music may be generated by themusical algorithms. The device also operates as a musical composerassistant. An FM receiver 23 is provided in the DMM so that a user isable to tune to a favorite radio station or to a virtual radio station.While music is playing a user is able to take control over automaticcomposition being undertaken by the musical algorithms 21 and to add theusers own touches. The user may interact with the music being played byway of changing the tempo and pitch. Consequently, interaction isavailable in as much as the user is able to play voice, music or soundsamples that can be recorded with a built in microphone or obtained fromthe FM radio receiver or any other source. The samples are obtainedthrough the use of a high quality audio compression circuit 24 and arestored in the SmartMedia memory section 19. The controls 13 on the faceof the DMM (FIG. 1) provide for introducing the sound effects such aswobbler, dobbler, etc. and can be applied at a user's will duringplayback of the recorded samples. Additionally the controls allow theuser to take even more control over the musical content by selectingrelative volume of an instrument or a group of instruments in a fashionnormally only possible through the use of a mixing table. The sound of aparticular instrument may be altered using filters and also may be savedto be later played over again and even to be edited later. Controls 13are intuitive using traditional player keys while the graphical displayof 14 provides visual feedback in real time of the action the user isundertaking with the musical content. As a result users with no specialmusical education or skill are able to alter and compose music to theirown designs.

[0032] Audio compression circuit 24 preferably is a circuit based on aspeech compression algorithm using, for example, adaptive differentialpulse coded modulation (ADPCM) that can be applied to a useful portionof the recording. As is known in the art, techniques such as PCM andADPCM provide methods of compression of analog data that has beensampled and digitized, typically in which the samples have beendigitized, and difference between samples are stored/sent (rather thanthe samples themselves), or with adaptive techniques a predictedsample/sample difference is computed, and what is stored/transmitted isthe difference between the predicted value and the actual value, etc.Such compression techniques are known in the art and used, for example,in various telephony-type systems.

[0033] A built in microphone (not shown) in the DMM is used for Karaokeand DJ functions. Further, it is used with a music synthesizer 26 toprovide for audio mixing and other audio sound effects. The synthesizer26 provides a MIDI interface whereby, due to the small size of a MIDIfile, a large number of songs may be made to fit in the flash memory 19containing the SmartMedia cards. The SmartMedia Flash memory providesfor storage of compressed digital/audio MIDI/Karaoke files and voicesamples. This is currently the most compact Flash Memory form available.The digital nature of the MIDI files allows tempo and pitch of music tobe dynamically adapted to the users requirements. Moreover, when asinger's voice is taken from the built in microphone within the DMM andmixed with synthesized or stored sound samples, lyrics may be displayedon a TV/video interface 27 or on the display 14 of FIG. 1. An externalmicrophone may be plugged into the DMM for even more flexible usage.

[0034] When the DMM is connected to the docking station 11 and playingMIDI or Karaoke songs, a digital light show is available through theTV/video interface 27. The resulting colorful patterns have movementsand shapes following the beat of specific instruments or serve as acompliment to lyrics displayed on the screen 14 or just as a visualassist to the electronic DJ music.

[0035] A universal serial connection 28 to a personal computer allowstransfer of audio files to and from the SmartMedia/flash memory 19.Additionally the serial connection is available to perform a firmwareupgrade. The MIDI interface 26 in the DMM 10 converts to a synthesizerwhen connected to a MIDI sequencer through the USB PC interface 28.Firmware for the DMM is stored in the Flash Memory and can therefore beupgraded readily by a user by downloading through the MIDI PC interface28. A digital instrument tuner for all modern and classical instrumentsis shown in FIG. 2 at 32.

[0036] The compact design obtained in the DMM to afford the portablenature of the device is obtained by housing some functions required onlywhen using the product in a nonmobile environment to be placed in thedocking station 11 of FIG. 1. These functions include the circuitryrequired for the insertion of Karaoke lyrics in a video source and fordisplay on a TV screen as well as an external microphone connection forKaraoke recording. A MIDI in/out interface is provided in the dockingstation 11 for connection to a personal computer or to another MIDIdevice. A power jack and charge control (not shown) is provided at therear of the docking station to provide the DMM with a 3.3 volt powersupply in a preferred embodiment as shown at 33 in FIG. 2. The DMM isconfigured to include two AA batteries. These may be rechargeable orregular batteries. Multiple functions are provided through controls 13on the DMM such as compressed audio playback, electronic DJ, voice andsound samples and radio. Playback and record keys are available on theface of the DMM together with general volume control keys. Power, videoand audio connectors, and microphone input connectors are provided onthe docking station 11. Additionally, the docking station has a standardMIDI interface with in and out connectors. This interface is useable forcommunication with a personal computer for audio file transfer orfirmware upgrade.

[0037] The invention disclosed herein is useable by persons having noappreciable musical expertise. It presents a new way of listening tomusic wherein a user may modify existing music, compose new music, andsave and play back music. Music patterns composed by the user or takenfrom favorite composers may be retained in a music database or library.The composition device of the present invention utilizes a combinationof notes rather than sounds. Notes, being represented digitally, requireless memory for storage than sounds that are usually represented inanalog form and take large amounts of memory, comparatively, whendigitized.

[0038] Further, digital notes are easily altered while digital soundsare not readily changed. As a result, the instant invention may use amicroprocessor operating at about 25 MHz and needs only about two (2)megabytes of storage, although, of course, the particular clock speedand storage size are exemplary embodiments and the invention is notlimited thereto. This may be seen to be much less processor speed andmemory than used in the least capable desktop computer, for example.

[0039] According to the functional diagram of FIG. 3, one typicalembodiment of the automatic composition device of the present inventionincludes essentially a processor 36, a memory 37 containing a musicdatabase for use in the automatic composition device, a memory 38 forstoring sound samples utilized by the automatic composition device, amusic synthesizer 39, and a summation and digital to analog conversioncircuit 41 interconnected as shown. Processor 36 is able to composeautomatically a melody out of the database stored in memory 37 using anautomatic composition algorithm containing composition instructions. Theautomatic composition algorithm also utilizes the sound samples storedin memory 38, in such a way that processor 1 delivers in synchronism onits output a control signal M1 connected to synthesizer 39 and a soundsample signal S2. An output signal M2 of the synthesizer and soundsample signal S2 are then summed and converted to analog form in circuit41 to deliver the complete audio signal MA3. This audio signal MA3,which forms the output of the invention, can then be presented in audioform by a stereo sound system.

[0040] In a preferred embodiment of the invention, the processor is madeof a microprocessor or microcontroller having a synchronizing clock andbeing linked to one or several memories. Clock speed and memory capacitymay be relatively low, 25 MHz and 2 MB being ample in the preferredembodiments. A RAM memory (volatile memory) can serve as the workingmemory of the microprocessor and can be used to store the sound samplesin memory 38, whereas a ROM or EPROM memory can store the microprocessorprogram and the music database in memory 37 used by the automaticcomposition device. However, a greater flexibility will be granted bynon-volatile memories: RAM memory saved by a disposable or rechargeablebattery, or Flash EEPROM memory (electrically erasable). Thenon-volatile memory can be used at the very least to store the soundsamples in memory 38, so that they are saved when the invention ispowered off. It can also be used to store the music database in memory37 for use by the automatic composition device, as well as amicroprocessor operating program. This permits easy update of the musicdatabase and the microprocessor operating program by means ofdownloading updates.

[0041] The summing of output signal M2 of the synthesizer and of soundsample signal S2 is obtained using various methods and circuitrydescribed as follows.

[0042] In a first scheme for performing the summing of M2 and S2 (FIG.4), output signal M2 of synthesizer 39, which is a digital signal, isconverted to an audio signal MA2 by digital to analog converter 42.Sound sample signal S2 generated by processor 36, which is also adigital signal, is separately converted to an audio signal SA2 by asecond digital to analog converter 43. Then audio signals MA2 and SA2are summed by analog adder 44 to deliver an audio output signal MA3. Theanalog adder 44 can consist of an operational amplifier mounted in anadder configuration.

[0043] In a second manner of performing the summing of M2 and S2 (FIG.5), output signal M2 of synthesizer 39 and sound sample signals S2generated by processor 36 are added by digital adder 46 to form acombined digital signal M3. This digital signal is then converted to anaudio signal MA3 by a digital to analog converter 47. While this mannerof performing the summing requires only one digital to analog converter47, it nevertheless requires a digital adder 46.

[0044] In a variant of the second manner of performing the summing of M2and S2 (FIG. 6), output M2 of synthesizer 39 is sent back to processor36, which then performs by itself the summing of digital signals M2 andS2 (in this variant, signal S2 only exists in a virtual form in theprocessor). Thus, the processor delivers directly on output M3 thecompound digital signal, which is converted to an audio signal MA3 bydigital to analog converter 47. This variant requires only one digitalto analog converter and does not require a specific digital addercircuit, but conversely it requires an additional input on the processorto read the output of the synthesizer.

[0045] In a second variant of the second manner of performing thesumming of M2 and S2 (FIG. 7), which is applicable to the case wheresynthesizer 39 itself comprises a processor (microprocessor and/ordigital signal processor), the summing of digital signals M2 and S2 canbe performed by the synthesizer modified for this purpose. Indeed,either the synthesizer has an additional input to read signal S2 asshown in FIG. 7, or signals M1 and S2 are multiplexed on a single inputof the synthesizer (variant not shown on a figure). In the latter case,if a MIDI standard protocol is used, the multiplexing of signals M1 andS2 will be made much easier by putting the information relevant to soundsample signals S2 in “System Exclusive” MIDI messages. Thus, thesynthesizer performs internally the summing of signals M2 and S2 (inthis variant, signal M2 only exists in a virtual form in thesynthesizer) and delivers directly on output M3 the compound digitalsignal, which is converted to an audio signal MA3 by digital to analogconverter 47. This second variant also requires only one digital toanalog converter and does not require a specific digital adder circuit,but conversely, compared with a standard synthesizer circuit, itrequires a modification of the synthesizer to read and add sound samplesignals S2.

[0046] In another preferred embodiment of the invention, applicable tothe case where synthesizer 39 itself comprises a processor, memory 38for storing sound samples is linked to synthesizer 39 instead ofprocessor 36. Given that synthesizer 39 already possesses a memory thatcontains instrumental sounds that are used as basic units for musicsynthesis, a variant of this embodiment consists in storing the twotypes of sounds, i.e., the basic instrumental sounds and the soundsamples, in a sounds memory 48 as shown in FIG. 8. In this embodiment,the summing of digital signals M2 and S2 is naturally performed by thesynthesizer, according to the same process as described for the variantof FIG. 7. Thus, the program executed by the processor of thesynthesizer 39 is modified to permit these new operations (storing soundsamples and summing them with instrumental sounds). The programmodifications performed by the processor of the synthesizer can beminimized by organizing the program in such a way that the synthesizerprocesses sound samples as a special case of basic instrumental sounds;for example, as by assigning a MIDI channel to the sound samples or asan alternative by defining the sound samples as special notes of apercussion type instrument.

[0047] In a preferred embodiment of the invention, the invention allowsa user to record sound samples with a microphone via commands thatpermit the user to start and stop a recording. An internal microphoneand/or an external microphone input is required. As seen in FIG. 9, amicrophone 49 provides an output S1A1 connected to the input ofpreamplifier 51. An analog to digital converter 52 converts themicrophone signal S1A1 to digital sample signals S12. The sample signalsare read by processor 36 and stored either in its memory 38, or, in thecase of the embodiment of FIGS. 7 and 8, in the memory contained withinthe synthesizer 39. The memory may be RAM or flash as indicatedpreviously.

[0048] Various processes may optionally be used to reduce the memoryrequirements to store the samples. The following examples are notlimiting:

[0049] (a) once the recording is over, the silent periods which precedeand follow the useful portion of the recording can be eliminatedautomatically;

[0050] (b) a speech compression algorithm such as Adaptive DifferentialPulse Coded Modulation (ADPCM) 24 can then be applied to the usefulportion of the recording.

[0051] In the process of automatic composition of music, the processorcan treat the sound sample signals as a special case of a musicalinstrument. Thus, the association of sound sample signals with the notessent by the instruments is an integral part of the automatic compositionprocess. The processor then extracts information from the available poolof sound samples in the same way as from the music database.

[0052] However, the processing of sound samples has certain features.First of all, the invention is not restricted to using sound samplesthat have been pre-recorded for a given type of instrument, but alsoenvisions using sound samples that have been recorded freely by theuser. In addition to some special effects that will be described later,the processing of sound samples consists of selecting a sample in thepool of available samples according to a pseudo-random sequence, thenselecting the moment to start playing the sample, taking into accountthe melody that the processor is simultaneously composing, in such a waythat the sample starts at the beginning of a musical bar, or in specificcases at another moment that is governed by certain musical laws (whichmay depend on the music style). The sound sample can then be playedeither in its entirety or in part, and it can be repeated or notrepeated.

[0053] Furthermore, the sound samples may be modified to include variousspecial effects depending on the style of music created by the automaticcomposition device. To quote only a few of such special effects: echoaddition, vibrato, distortion, frequency modulation, various filteringprocesses to shape the sound spectrum, etc.

[0054] One aspect of the current invention relates to a system such asdescribed above that also may include, or be included in, an automaticsoundtrack generator that operates to merge an independent sound trackwith a video sequence during recording or playback of the sequence(aspects of the other embodiments described herein could be used torecord or playback desired audio tracks in conjunction with video thatbeing recorded and/or played back, etc.). FIG. 10 represents a system inblock diagram form showing an external video input 53 providing a signalV1 to a video and sound recording module 56 connected to store thesignal V1 on storage unit 58 such as a tape or a digital memory. Thestorage unit is connected to a video and sound playback module 61 thatproduces an output V2 connected to a video output module 62 and an audiooutput A2 connected to a sound generation module 57. Items 56, 58, 61and 62 are generally contained in a commonly known camcorder device. Thecamcorder device also includes an external sound input element 54, suchas a microphone, producing an audio output A1. Output A1 is alsoconnected to sound generation module 57. A control module 59, shownconnected to items 56, 58, 61 and 57 in FIG. 10, selects soundsgenerated by sound generation module 57 to produce output S2 providingaudio output 63.

[0055] According to the functional diagram of FIG. 11, the invention cantypically be embodied by a module that generates music or other soundsand which comprises essentially processor 36, memory 37 containing themusic database of the automatic composition device, musical synthesizer39, memory 38 storing the sound samples for the musical synthesizer, adigital to analog conversion circuit 43, a summation circuit 58 and amemory 43, internal or external to the invention, containing a libraryof digitized musical files. The memory elements 37, 38 and 42 can bemade of one or several distinct physical components. Processor 36 isable to select, according to certain criteria that are pre-defined ordefined by a user, musical files out of the library in memory 42, or isable to compose automatically a melody out of the database stored inmemory 37, with an automatic composition algorithm. The output signal S3of the synthesizer, after digital to analog conversion in converter 43,delivers an analog signal A3 which can optionally be mixed with therecorded audio A2 or with the external audio input A1 in summationcircuit 58 to deliver the mixed complete audio signal S1/S2. This mixedaudio signal S1/S2, which forms the output of the invention, can then beused as a sound source at video/audio record time (real time) (S1) or atplay back time (time shifted) (S2). As a result prerecording of moviesoundtracks, for example, is unnecessary. A simple way is provided for auser to change sound content, pitch, etc. for implementation in a videosoundtrack.

[0056] In a preferred embodiment of the invention, the processor 36 ismade of a microprocessor or microcontroller linked to one or severalmemories. A RAM memory (volatile memory) can serve as the working memoryof the microprocessor, whereas a ROM or EPROM memory can store themicroprocessor program and the music database 37 of the automaticcomposition device. However, a greater flexibility will be granted bynon-volatile memories: RAM memory saved by a disposable or rechargeablebattery, or Flash EEPROM memory (electrically erasable). Thenon-volatile memory can be used to store the music database 37 of theautomatic composition device and the digitized musical files of thelibrary in sound samples memory 38, as well as the microprocessorprogram. This permits easy update for the music database and themicroprocessor program.

[0057] The synthesizer 39 and the microprocessor 36 of FIG. 11 cooperateto select banks of sound samples according to predetermined processorinstructions to provide the synthesizer output S3. The sound samplebanks contain sounds in digital form of predetermined instruments.

[0058] The processor 36 can also be used to select the sound source orsources described above. Furthermore, the processor can be used toselect commands which permit activation functions such as playing arecording, selecting and mixing an audio source, or controlling anyother functions that are commonly found in video recorder basedequipment. This combines the functions of blocks 57 and 59 of FIG. 10.

[0059] According to another feature of the present invention, a deviceis provided that simulates a radio station including a player of musicalpieces, either recorded and digitized or synthesized. According to thefunctional diagram of FIG. 12, a typical embodiment of the inventioncomprises essentially a processor 36, a memory 37 containing a musicdatabase for use by an automatic composition algorithm, a memory 38storing the sound samples, a musical synthesizer 39, a summation anddigital to analog conversion circuit 43, a radio receiver 64 and amemory 42, internal or external to the invention, containing a libraryof digitized musical files, wherein these elements are interconnected asshown. The memory elements 37, 38 and 42 can be made of one component orseveral physically distinct components. Processor 36 is in communicationwith the memory elements and is able to select, according to certaincriteria, musical files out of the library of musical files or is ableto compose automatically, according to the automatic compositionalgorithm, a melody out of the database stored in memory 37. Theautomatic composition algorithm also utilizes the sound samples storedin memory 38, which may include some speech sentences, in such a waythat processor 36 delivers in synchronism on its outputs a controlsignal M1 connected to synthesizer 39 and a sound sample control signalS2. Output signal M2 of the synthesizer and sound sample control signalS2 are then summed and converted to analog form in circuit 43 thatprovides the complete audio signal MA3 for connection to a speaker orspeakers (not shown). In a similar way, the output of radio receiver 64can be mixed upstream, as a digital signal, or downstream, as an analogsignal, of circuit 43 to add a supplementary sound source to thecomplete audio signal MA3. The audio signal MA3 forms the output of theinvention that can then be played by the aforementioned speakers in astereo system.

[0060] In a preferred embodiment of the invention, the processor is madeof a microprocessor or microcontroller linked to one or severalmemories. A RAM memory (volatile memory) can serve as the working memoryof the microprocessor and can be used to store the sound samples 38,whereas a ROM or EPROM memory can store the microprocessor program andthe music database 37 used by the automatic composition algorithm.However, a greater flexibility will be granted by non-volatile memories:RAM memory saved by a disposable or rechargeable battery, or FlashEEPROM memory (electrically erasable). The non-volatile memory can beused at the very least to store the sound samples in memory 38, so thatthey are saved when the invention is powered off. It can also be used tostore the music database in memory 37 for use by the automaticcomposition algorithm, the digitized musical files of the library 42, aswell as a microprocessor operating program. This permits easy update ofthe music database and the microprocessor operating program by means ofdownloading updates.

[0061] Processor 36 can also be used to select the sound source orsources, including radio receiver 64 or one of the sources in memories37, 38 and 42 described above. It can also be used to select one of anumber of preset radio stations, including either actual radio stationsor illusory radio stations. Illusory stations in reality play soundsamples and musical pieces that have been stored in digital form or thatare composed automatically as described herein. Moreover, a sound inputdevice, such as a microphone 66, is useful to input voice signals,encoded in memory, to be used in construction of illusory radio stationsound patterns.

[0062] The controls 13 to which reference was made in FIG. 1 include ajoystick and a number of direct access keys to simplify entry intovarious interactive modes by users of the DMM device of the presentinvention. Certain operating sequences for specific interactive modeswill now be described.

[0063] To enter Electronic-DJ, press the [e-DJ] direct access key. TheLCD will display “E-DJ” in the status line and a selection of musicstyles is proposed: Techno, Dance, Hip-Hop, etc.

[0064] To select the desired style, use Joystick Up/Down

[0065] To start playing auto-composed music of the selected style, pressthe play/pause key the LCD will display the music I-way screenrepresenting six instrument lanes: Drums, Bass, Riff, Lead Samples andMicrophone. The screen is animated with sound waves or pulsessynchronized with music beats.

[0066] To change music tempo, press Pitch/Tempo key together withjoystick left to speed up or right to slow down.

[0067] To change music pitch, press Pitch/Tempo key together withjoystick left to speed up or right to slow down.

[0068] To change music pitch, press Pitch/Tempo key together withjoystick up to higher the pitch or down to lower it.

[0069] Press play/pause to pause the music.

[0070] Press stop to stop the music and go back to style selectionscreen.

[0071] Press forward to start a new song.

[0072] Press backward to restart the current song.

[0073] Press Save/Edit key to save the current song as a user song onthe SmartMedia card.

[0074] To select a specific lane, use joystick left/right. The image onthe screen will shift left or right and present the I-way seen from thenew lane.

[0075] To change the relative volume of the current lane, press Effectskey together with the joystick up or down.

[0076] To change the reverb on the current lane, press Effects keytogether with the joystick left or right.

[0077] To enter the Underground mode for the current lane and loop thecurrent sequence, press joystick down.

[0078] The transition to music tunnel is marked by a screen animationand the under ground mode is entered for the selected instrument orsound source (sample or microphone). The U-ground screen shows theinside of a tunnel with sound waves on both sides and beat pulses comingtowards the user. The shape of the far side of the tunnel is modifiedwith the sound effect applied.

[0079] The music will loop as long as the user remains in theUnderground mode.

[0080] In Instrument Tunnels (Drums, Bass, Riff and Lead):

[0081] Use Joystick right to select a new music pattern. Use joystickleft to come back to previous patterns.

[0082] Press Joystick up to go back to music I-way.

[0083] To change the cutoff frequency of the filter on the currentinstrument, press Effects key together with joystick up or down.

[0084] To change the resonance of the filter on the current instrument,press Effects key together with joystick left or right.

[0085] Press stop to mute the instrument.

[0086] Press play/pause to un-mute the instrument.

[0087] In the Sample Tunnel:

[0088] Use Joystick left/right to select a sample.

[0089] Press Joystick up to go back to music I-way.

[0090] To change the sample volume, press Effects key together withjoystick up or down.

[0091] To choose a different sample effect, press Effects key togetherwith joystick left or right.

[0092] Press play/pause to play the sample. If sample playback had beenpreviously disabled (see below), the first press on play/pause willre-enable it. Following presses will play the selected sample.

[0093] Pressing stop will disable the automatic playback of samples bythe e-DJ when returning to I-way mode.

[0094] In the Microphone Tunnel:

[0095] Use Joystick left/right to select the active microphone: built-inor docking station. If the docking station is not connected, noselection is available.

[0096] Press Joystick up to go back to music I-way.

[0097] To change pitch on the microphone input, press Pitch/Tempo keytogether with joystick up or down.

[0098] To change the microphone volume, press Effects key together withjoystick up or down.

[0099] To modify the microphone echo, press Effects key together withjoystick left or right.

[0100] Press stop to mute microphone.

[0101] Press play/pause to un-mute the microphone.

[0102] To exit Electronic-DJ mode, choose any other mode by pressing theappropriate direct access key.

[0103] Playback of compressed audio and Karaoke is accessible in the“Songs” mode. This mode allows to play digitally recorded WMA (MP3)songs, MIDI songs, Karaoke songs and User songs saved during an e-DJsession.

[0104] To enter Songs mode, press the [Songs] direct access key. The LCDwill display “e.Songs” in the status line and a list of available songsor song lists on the SmartMedia card to choose from. Song lists areidentified by a specific icon.

[0105] To select the desired song or list, use Joystick Up/Down.

[0106] To start the playback of selected song or song list, press theplay/pause key. The LCD will display the play song screen. The name ofthe song is scrolling in a banner in the center right part of the LCDwhile the audio output level is materialized by a frame around the namewhich size is changing following the audio level. The status line showsthe elapsed time.

[0107] If the song is a Karaoke song, the Lyrics are displayed at thebottom of the LCD. Note: if the song is a user song (composed with thee-DJ), the music I-way mode is entered instead of the play song mode.

[0108] To change music tempo, press Pitch/Tempo key together withjoystick left to speed up or right to slow down.

[0109] To change music pitch, press Pitch/Tempo key together withjoystick up to higher the pitch or down to lower it.

[0110] Press play/pause to pause the music. Press play/pause again toresume playback.

[0111] Press stop to stop the music and go back to song selectionscreen.

[0112] Press forward to go to next song.

[0113] Press backward to go to previous song.

[0114] Pressing the Save/Edit key in the song select screen or while asong is playing enters the song edit mode. Depending on the type of thesong (user song, MIDI or WMA), different parameters can be edited.

[0115] Pressing the Save/Edit key in the song select screen while thecurrent item is a song list enters the song list edit screen. See“Editing items” below.

[0116] Pressing forward key in the song select screen will create a newsong list.

[0117] To exit Songs mode, choose any other mode by pressing theappropriate direct access key.

[0118] Playback of compressed audio and Karaoke is accessible in the“Songs” mode. This mode allows to play digitally recorded WMA (MPA3)songs, MIDI songs, Karaoke songs and User songs saved during an e-DJsession.

[0119] To enter Songs mode, press the [Songs] direct access key. The LCDwill display “e.Songs” in the status line and a list of available songsor song lists on the SmartMedia card to choose from. Song lists areidentified by a specific icon.

[0120] To select the desired song or list, use Joystick Up/Down.

[0121] To start the playback of selected song or song list, press theplay/pause key. The LCD will display the play song screen. The name ofthe song is scrolling in a banner in the center right part of the LCDwhile the audio output level is materialized by a frame around the namewhich size is changing following the audio level. The status line showsthe elapsed time.

[0122] If the song is Karaoke song, the Lyrics are displayed at thebottom of the LCD. Note: if the song is a user song (composed with thee-DJ), the music I-way mode is entered instead of the play song mode.

[0123] To change music tempo, press Pitch/Tempo key together withjoystick left to speed up or right to slow down.

[0124] To change music pitch, press Pitch/Tempo key together withjoystick up to higher the pitch or down to lower it.

[0125] Press play/pause to pause the music. Press play/pause again toresume playback.

[0126] Press stop to stop the music and go back to song selectionscreen.

[0127] Press forward to go to next song.

[0128] Press backward to go to previous song.

[0129] Pressing the Save/Edit key in the song select screen or while asong is playing enters the song edit mode. Depending on the type of thesong (user song, MIDI or WMA), different parameters can be edited.

[0130] Pressing the Save/Edit key in the song select screen while thecurrent item is a song list enters the song list edit screen. See“Editing items” below.

[0131] Pressing forward key in the song select screen will create a newsong list.

[0132] To exit Songs mode, choose any other mode by pressing theappropriate direct access key.

[0133] In the “playing samples” mode, the user can record or play voice,music or sound samples.

[0134] To enter Samples mode, press the [Samples] direct access key. TheLCD will display “e.Samples” in the status line and a list of availablesamples or sample lists on the SmartMedia card to choose from. Samplelists are identified by a specific icon:

[0135] To select the desired sample or list, use Joystick Up/Down. Toselect the desired sound effect, press Effect key together with joystickleft/right.

[0136] To change the sample volume, press Effect key together withjoystick up/down.

[0137] To start the playback of the selected sample, press theplay/pause key. The LCD will display the play sample screen. The name ofthe sample is scrolling in a banner in the center right part of the LCDwhile the audio output level is materialized by a frame around the namewhich size is changing following the audio level. The status line showsthe current effect.

[0138] Press stop to stop the sample and go back to sample selectionscreen.

[0139] Pressing the Save/Edit key in the sample select screen or while asample is playing enters the sample edit mode.

[0140] Pressing the Save/Edit key in the sample select screen while thecurrent item is a sample list enters the sample list edit screen. See“Editing items” below.

[0141] Pressing forward key in the sample select screen will create anew sample list.

[0142] To exit Sample mode, choose any other mode by pressing theappropriate direct access key.

[0143] Recording samples is a simple operation possible in almost anyoperating mode of the dB1.

[0144] Press record and keep record button down to record a sample.Release the record button to end the recording. Recording is stoppedautomatically if the sample duration exceeds 30 seconds.

[0145] The record source is chosen automatically depending on theoperation mode.

[0146] While e-DJ is playing (I-way or U-ground modes), the record isinactive.

[0147] If no music is playing, the record source is the activemicrophone (built-in or docking station).

[0148] If music is playing (songs or radio), the record source is a mixof the music and the microphone input if not muted.

[0149] To enter Virtual radio mode, press the [v-Radio] direct accesskey. The LCD will display “v.Radio” in the status line and a list ofavailable station presets to chose from as well as t currently tunedfrequency. If no preset has been stored, only the currently tunedfrequency is displayed.

[0150] To select the desired station, use Joystick Up/Down.

[0151] To listen to the selected station, press the play/pause key. TheLCD will display the radio screen. The name of the radio station (orfrequency if it is not a stored preset) is scrolling in a banner in thecenter right part of the LCD. An animation representing radio waves isalso displayed. The status line shows the tuned frequency.

[0152] Use Joystick left/right to go to previous/next station is in thepreset list.

[0153] Press play/pause to mute the radio.

[0154] Press stop to go back to station preset selection screen.

[0155] Press forward to tune up.

[0156] Press backward to tune down.

[0157] Pressing the Save/Edit key in the station preset selection screenenters the preset edit mode.

[0158] Pressing the Save/Edit key while a station is playing will storeit in the preset list.

[0159] To exit v.Radio mode, choose any other mode by pressing theappropriate direct access key.

[0160] As long as no music is playing and in the v.Radio mode, themicrophone settings are made as follows:

[0161] To change the pitch on the microphone input, press Pitch/Tempokey together with joystick up to increase the pitch or down to lower it.

[0162] To change the microphone volume, press Effects key together withjoystick up/down.

[0163] To modify the microphone echo, press Effects key together withjoystick left/right.

[0164] Reference is also made to co-pending U.S. application Ser. Nos.______ and ______ filed on even date herewith for “Virtual Radio” and“Automatic Soundtrack Generator,” both of which are incorporated byreference herein and both of which may utilized, alternatively, withembodiments of the present invention.

[0165] Although the invention has been described in conjunction withspecific preferred and other embodiments, it is evident that manysubstitutions, alternatives and variations will be apparent to thoseskilled in the art in light of the foregoing description. Accordingly,the invention is intended to embrace all of the alternatives andvariations that fall within the spirit and scope of the appended claims.For example, it should be understood that, in accordance with thevarious alternative embodiments described herein, various systems, anduses and methods based on such systems, may be obtained. The variousrefinements and alternative and additional features also described maybe combined to provide additional advantageous combinations and the likein accordance with the present invention. Also as will be understood bythose skilled in the art based on the foregoing description, variousaspects of the preferred embodiments may be used in varioussubcombinations to achieve at least certain of the benefits andattributes described herein, and such subcombinations also are withinthe scope of the present invention. All such refinements, enhancementsand further uses of the present invention are within the scope of thepresent invention.

What is claimed is:
 1. An interactive digital music device providingmultiple features for a user, comprising programmable memory for storingdigital audio and voice samples, receivers for obtaining external soundsignals, means for playing said stored audio and voice samples andexternal sound signals, means for storing automatic musical compositioninstructions, whereby the user is able to create unique musicalcompositions, and means for mixing external sound signals with saidunique musical compositions and stored audio and voice samples toprovide altered audio and voice presentations.
 2. The interactivedigital music device of claim 1, comprising means for providing visualeffects complementing said altered audio and voice presentations.
 3. Theinteractive digital music device of claim 2, wherein said means forproviding visual effects, comprises visual means for providing writtensong lyrics.
 4. The interactive digital music device of claim 2, whereinsaid means for providing visual effects, comprises visual means forproviding complimentary light patterns for said altered audio and voicepresentations.
 5. The interactive digital music device of claim 1,wherein said programmable memory comprises flash memory, and whereinsaid received radio signals, unique musical compositions and alteredaudio and voice presentations are digitized.
 6. The interactive digitalmusic device of claim 1, comprising a television signal interface.
 7. AnAutomatic Composer in a digital multi-media device for composing amusical piece according to automatic composition instructions and formixing sound samples into it, comprising a processor having an input andan output, said processor operating to implement the automaticcomposition instructions, a memory for storing a music database for usein accordance with the automatic composition instructions, a secondmemory for storing the sound samples, said first and second memoriesbeing connected to the processor input, a music synthesizer connected tothe processor output for control by said processor and providing asynthesizer output, and a summation and digital to analog conversioncircuit for receiving processor and synthesizer outputs and forproviding a summed analog output.
 8. The Automatic Composer as set forthin claim 7, wherein said summation and digital to analog conversioncircuit, comprises a digital to analog converter for receiving saidsynthesizer and processor outputs and for providing analog signals, andsecond a summation circuit for receiving said analog signals.
 9. TheAutomatic Composer as set forth in claim 7, wherein said summation anddigital to analog circuit comprises a digital adder for summing theprocessor and synthesizer outputs and for providing a summed digitaloutput, and a digital to analog converter for receiving said summeddigital output.
 10. The Automatic Composer as set forth in claim 9,wherein said processor comprises an internal digital adder.
 11. TheAutomatic Composer as set forth in claim 9, wherein said synthesizercomprises an internal digital adder.
 12. The Automatic Composer as setforth in claim 7, wherein said synthesizer comprises an additionalprocessor for directly accessing said memory for storing sound samples,and wherein said synthesizer comprises means for handling sound samplesas a special case of basic instrumental sounds.
 13. The AutomaticComposer as set forth in claim 7, comprising a microphone for recordingexternal sound samples, and means for starting and stopping recording.14. The Automatic Composer as set forth in claim 13, further comprisingmeans for automatically eliminating the silent periods that precede andfollow a useful portion of a recording, and means for implementing aspeech compression algorithm to compress the useful portion of therecording.
 15. The Automatic Composer as set forth in claim 7, whereinsaid processor comprises means for integrating said sound samples intomusical compositions, means for functioning to select said sound samplesaccording to a pseudo-random sequence, means for directing said sampleto be played at a predetermined time between the beginning and the endof a musical bar as governed by certain musical rules, means fordirecting any portion of the sound sample to be played from its entiretyto any part thereof, and means for optionally selecting repetition ofthe sound sample.
 16. The Automatic Composer as set forth in claim 7,wherein said processor comprises means for imparting special effects tothe musical piece, whereby the musical piece is optionally modified withany ones of echo, vibrato, distortion, frequency modulation, andfiltering effects.
 17. The Automatic Composer as set forth in claim 7,wherein said processor comprises a clock operating at 25 MHz maximum,and wherein said first memory and said second memory comprise a memoryhaving a capacity of 2 MB maximum.
 18. An Automatic Soundtrack Generatorin a digital multi-media device that is capable of mixing a signal froman external audio source in a video/audio record and/or play device withan internal audio source containing digitized sound files in accordancewith predetermined mixing instructions, comprising a processor, a memoryelement connected to said processor for storing mixing the instructionsand the digitized sound files, a digital to analog conversion circuitfor receiving the digitized sound files, and a summation circuit forcombining the signal from the external audio source with the digitizedsound files.
 19. The Automatic Soundtrack Generator as set forth inclaim 18, further comprising a digital musical synthesizer, and a storeof pre-recorded and automatically composed MIDI files, wherein selectedones of said store of MIDI files are connected to said digital musicalsynthesizer for providing the internal audio source.
 20. The AutomaticSoundtrack Generator as in claim 18, further comprising a useraccessible input, and means for selecting the internal audio sourceconnected to the user accessible input and defined by the user.
 21. TheAutomatic Soundtrack Generator as defined in claim 18, furthercomprising an additional memory means containing preprogrammedinstructions for defining the internal audio source, and means forselecting the internal audio source connected to said additional memorymeans.
 22. The Automatic Soundtrack Generator as set forth in claim 18,comprising means for selecting the internal audio source at video/audiorecord time.
 23. The Automatic Soundtrack Generator as set forth inclaim 18, comprising means for selecting the internal audio source whenplaying a previously recorded video/audio sequence.
 24. A Virtual Radioin a digital multi-media device that is capable of selecting, accordingto given criteria, musical files from predetermined sound sources forplaying from a speaker, comprising a processor providing a digitaloutput, a memory element connected to said processor for storing thegiven criteria and the predetermined sources of musical files, and asummation and digital to analog conversion circuit connected to receivesaid digital output and providing a predetermined analog sound output.25. The Virtual Radio device as set forth in claim 24, furthercomprising a digital musical synthesizer for adding MIDI files that arepre-recorded or composed automatically, according to the given criteria,to the predetermined sound sources.
 26. The Virtual Radio device as setforth in claim 24, comprising a radio receiver providing a sound outputused as an additional selectable sound source.
 27. The Virtual Radiodevice as set forth in claim 26, comprising means for providing voicefiles within the predetermined sound sources for combination with saidradio receiver sound output.
 28. The Virtual Radio device as set forthin claim 24, wherein sound samples are pre-recorded in the predeterminedsound sources by a user, comprising means for mixing speech sound withthe musical files.